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CHAPTER I 
THE PROGRAM 



The bilingual program of the Auxiliary Services for High Schools (ASHS) 
constitutes a parallel or alternative educational system in New York City 
for secondary school aged students who are bilingual or speak no English 
but only Spanish, French, Italian, Greek, or Chinese* It not only provides 
for those students who were former dropoucs or potential dropouts, but also 
for those students who were not achieving in secondary schools and were 
bilingual or non^English speaking and who needed to be served in a non- 
traditional type of program. The bilingual program within ASHS was established 
in 1972 in the Bronx and Manhattan; by 1974-1975 there were a total of twelve 
centers which continued to operate in 1975-1976. Of the fo^jr day centers, 
two are in Manhattan and one is in each of the boroughs of che Bronx and 
Brooklyn* All have bilingual programs in Spanish; each Manhattan center also 
has either a French or Chinese bilingual program. The eight evening centers 
are located in each of the five boroughs, two in Manhattan, Brooklyn, and 
Queens, and one in the Bronx and Staten Island. Five of the evening centers 
have Spanish bilingual programs; French, Greek, and Italian bilingual programs 
are provided at centers in Brookl3rn, Queens, and Staten Island, respectively. 
See Table 1. 
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Table 1 

Bilingual Program in ASHS, 1975-1976 



Center 



DAY: 

1. Ebbets Field 

School 

2. Forsyth Street 

School 

3. 93rd Street 

School 

4. Roberto 

Clemente 
EVENING: 

5. Brandeis HS 



6. Julia Rlchman 

HS 

7. Taft HS 



8. Prospect Hts. 

HS 

9. ^laxwell Voca- 

tional HS 

10. Jamaica Voca- 

tional HS 

11. JHS 10, Q. 



12. Staten Island 



Location 



65 Court Street 
Bklyn, NY 11201 

198 Forsyth Street 
NY, 'NY 10002 

257 W. 93 Street 
NY 

431 Jackson Ave. 
Bronx, NY 10455 

145 W. 84 Street 
NY, NY 10024 

316 E." 67 Street 
NY, NY 10021 

240 E. 172 Street 
Bronx, NY 10457 

Union & Classon Aves . 
Bklyn, NY 11225 

145 Pennsylvania Ave. 
Bklyn, NY U207 

162-02 Hillside Ave. 
Jamaica, NY 11432 

31 Ave. bet. 45 & 46 
Long Island City, NY 

St. Marks Place 
Staten Island, NY 



Hours 



Dominant' 
Language 



8:30AM-4PM Spanish 



8AM-4PM 
9AM-4PM 
9AM-4PM 



5:30-'9PM 



6-9PM 



Spanish 
Chinese 

Spanish 
French 

Spanish 



5: 30-8 :30PM Spanish 



5: 30-8 :30PM Spanish 



Spanish 



French 



5: 30-8 :30PM Spanish 



5: 30-8 :30PM Spanish 



5: 30-8 :30PM Greek 



5: 30-8 :30PM Italian 



The bilingual program primarily prepares pupils for the General 
Education High School Equivalency (HSE) examination in English or Spanish, 
the latter taken by those in the Spanish bilingual program. Therefore, 
emphasis is on the ac4uisitic;n of reading and mathematics skills. The 
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rrogram provides for the development of increasing English skills in English 
as a Second Language (ESL) . Beyond the ESL, however, the bilingual program 
uses native or dominant language to develop competencies in the areas of 
reading, mathematics, and, to a lesser extent, social studies and science. 
The instructional program in the native or dominant language also provides 
the opportunity for participants to retain and further develop their own 
cultural heritage. The bicultural aspect strengthens community participa- 
tion in the bilingual program and support for establishing examinations in 
French, Italian, Greek, and Chinese for the HSE Diploma. The pro'^gfaiT empha- 
sizes bilingual guidance and counseling for both the academic and vocational 
needs of students. 

The bilingual program is characterized by continuous movement of students 
into and out of the program. Students enter throughout the year and complete 
the HSE at various times, since examinations are scheduled several times a 
month. Some of those passing return for ESL and the regular ASHS program; 
others go on to further bilingual training and vocational educational programs 
offered by public and private agencies or obtain jobs. There is a core of 
^e^ularly attending students, but their number is less than the official 
register or enrollment for the class* Students frequently hold full- or part 
time jobs in addition to attending the ASHS bilingual program. 

Center facilities vary from regular school buildings to large multiple- 
use rooms. Of major impoitance is the location - in a community that can 
best be served by bilingual education. 
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A prospective student is either placed on a waiting list or accepted into 
the program immediately. Intake procedures include interviews with the counse- 
lor and/or educational advisor and diagnostic and placement testing. An indi- 
vidualized instr ictional program is prepared for each student. To implement 
the objectives of each student's program, individualized or small group instruc- 
tion is undertaken- Educational activities include English language skills 
(language skills and conversation), reading in .E.:glish, dominant language 
skills (instruction in the dominant language and culture in the academic content 
areas of the HSE) , and mathematics (offered in the dominant language). Counsel- 
ing services are provided by the educational advisor or the regular ASHS guid- 
ance counselor for the following purposes: educational counseling, college 
placement counseling, job development, job placement, vocational counseling, 
special bilingual counseling. 

To support instruction, curriculum development, establishment of bicultural 
curriculum resource files and resource libraries at each center are staff activ- 
ities. The bilingual staff is also encouraged to use the professional reference 
library at Clemente. Staff improvement procedures such as workshops, institutes, 
conferences, and participation in university programs are ongoing during the 
school year. 
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CHAPTER II 
EVALUATIVE PROCEDURES 

This chapter of the report describes the evaluation objectives, the 
evalMiition instruments ueed, the sample size, types of evaluation proce- 
dures used, and tnt- zime schedule. 
Evaluation Objectives 

Objective As a result, of participation in the bilingual program, 

the reading scores of the participants will show a statistically signifi- 
cant difference between pre- and posttests. 

Objective //2. As a result of participation in the bilingual program, 
students will show a statistically significant difference between pre- 
test ratlag and posttest rating in their ability to speak English. 

StJ-SSiiXSJ^ As a result of participation in the bilingual program, 
the reading level of the participant in the Spanish, Italian, Greek, French, 
or Chinese language will show a statistically significant difference be-- 
tween the pretest score anc', the posttest score. 

Objective H. As a result of participation in the bilingual program, 
the mathematics grade of the participant will show s statistically significant 
difference between pretest and posttest. 

s 

Objective //5. As the result of participation in the bilingual program, 
at least 80% of the students enrolled in the bilingual preparation component 
for t^.c riSii examxnatlon (Spanish language form), will pass the HSE in Spanish, 
:v.;v?^^^^^^^^- — - '^^ assess the discrepancy between the program as described 
In the proposal and the program planned and actually carried out in the 
Implementation. . i ^ / 
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Evaluation Instruments 

The Instruments used in the study Included formal standardized instru- 
ments and project-developed instruments. For Objective //I, the assessment 
of English language reading was obtained by using the Stanford Achievement 
Test, Primary I or Primary II. For students whose reading in English was 
at or above the ceiling of these tests, Metropolitan Achievfjment Tests or 
California Achievement Tests were given. In one center JHS 'rO^^Q, -the 
McCall-Crabbs Test was used. ^-^"^ 

For Objective //2, the assessment of speaking was made using the New 
York City Board of Education's Rating Scale of Pupil's Ability to Speak 
English on a pre- and posttest basis. This measure produces letter ratings, 
estimating English language ability in six letter categories, A to F. 

For Objective #3, different instruments were used for each respective 
language to assess the increase in competence in the student's ability to 
read in the respective native language. For Spanish, the InterAmerican 
Reading Test, Prueba de Lectura by Guidance Testing Associates, parts I and 
III, reading and vocabulary, was used; forms L3-CES and L3-DES were adminis- 
tered in pre- and posttesting, respectively. For French, the Science Re- 
search Associates' Laboratoire des Lectures was used for pre- and posttesting; 
this is a complete reading kit with pretest, placement, and instructional 
materials. Grade equivalents, determined by the number of words in the vari- 
ous sections, the number of words per sentence, the types of questions asked, 
were established by . the teacher of the course in consultation with the pub- 
lisher. For the Greek, Italian, and Chinese programs, project-developed 
tests were used since standardized tests are not available. Greek and Italian 
testing relied primarily on old New York State Regents examinations in high 
school Greek and Italian. To measure vocabulary and reading comprehension in 
Chinese, the teacher, using standardized reading tests in English as models, 
designed an original instrument. No claim is made for the reliability of -any 
of the project-developed tests. 
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For Objective //4, the New York Arithmetic Computation Test, Form D was 
used. This is a basic tool used by the Board of Education to assess mixed 
fundamental arithmetic skills for grades 7-^12. It was administered in the 
student's dominant language. 

A cumulative record card was maintained for each participant in the 
bilinsual program. HSE scores as well as results from other tests were 
entered on the card as obtained". 

The discrepancy analysis specified in Objective #6 was accomplished by 
the evaluator through^ site visits in which a checklist was used and through 
an interview schedule which was completed by center administrators. The 
•checklist and interview schedule were developed from the Program Proposal 
and included all of the essential program components. A copy of these instru- 
ments appears in the Appendix. 

Size of the Bilingu al Program and the Sample of Students Tested 

There have been 1243 students served by theASHS bilingual program in the 
1975-1976 school year. Of these, many have completed the program by passing 
the HSE, entering vocational training programs, getting jobs, etc. Some were 
discharged due to lack of attendance in order to make room for other students. 
Approximately 1,000 students were Spanish, almost 100 were French, 56 were 
Italian, 60 were Greek, and 24 were Chinese. Included in the total for the 
Ch-fry^ao vsre thrae VietNamese. 

For evaluation purposes, the sample consisted of those students who 
had both pre- and posttest scores for a specific test. This number varied 
since not every student was given every test. In some schools, students who 
were not enrolled in ESL were not tested in English language ability or reading 
in English. The Chinese bilingual program was so new that pupils spoke, under- 
stood, or read too little English to be tested. 
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Some students completed only a pretest but no posttest because of .dropping 
out of the program or leaving before posttests could be administered. 
Their scores could not be included in the final sample for the analysis of 
that particular evaluation objective. 

The sample of students consisted of those who had both pre-^ and post- 
test scores for a particular evaluation objective. 'Table. 2- indicates th^ 
enrollment in the bilingual program and the number of students included in 
the sample for each evaluation objective. Most students completed testing 
for reading in the dominant language and mathematics. 
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Table 2 

Size of Bilingual Program and Sample of Responses 



and Posttests for 
nation Objective; 









Enrolled 




/' ■ 


1^3 M 


Dominanv 




School 


in 


Read 


Speak 


Read 


Math 


Language 




ProRram 


Eng. 


Eng. 


Dom Lang 


Dom Lang 


Spanish 


1. 


Ebbets Field 


50 


25 


21 


48 


46 


Spanish 


2, 


Forsyth 


75 


69 


69 


69 


69 


Spanish 


3. 


93rd Street , 


63 


15 


31 


35 


35 


Spanish 


4, 


Clement e 


74 


15 


58' 


58 


55 


Spanish 


5, 


Brandeis 


250 


39 


156 


160 


158 


Spanish 


'/ « 


Richman 


83 


26 


37 


63 


62 


Spanish 


"» 


Taft 


200 


69 


168 


172 




Spanish 


9. 


Maxwell 


150 


38 


150 


150 


150 


Spanish 


10, 


Jamaica 


60 


0- 


57 


59 


59 


French 


3. 


93rd Street 


52 


20 


28 


52 


43 


French 


8, 


Prospect 


46 


42 


42 


44 


46 


Greek 


11, 


JHS 10, Q. 


60 


53 


56 


54 


54 


Italian 


12. 


Staten Island 


56 


22 


56 


45 


42 


Chinese 


2, 


Forsyth 


24 


0 


1 


15 


16 • 
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Evaluation Procedures 

Both formal and informal methods of assessment were used. Site 
visits were made where instructional groups were observed, professional 
and paraprofessional staff were interviewed, and conferences with center 
administrators were held. Center administrators were asked to evaluate 
the program in their own center for a discussion of stre hs and weak- 
nesses at one of their monthly meetings; a copy of the -y^mda is appended. 

Evaluation records were distributed to each center administrator to 
report pre- and posttest data and other relevant statistics for each 
student. These forms and interview schedules were submitted to the pro- 
gram coordinator for transmittal to the evaluator. 

Statistical analysis was performed separately for each center. At 
centers where two bilingual programs were implemented, data from each 
program were analyzed separately. Methods of statistical analysis used 
relied primarily on the correlated ;t test. In addition, the Sign Test' 
was used for. the assessment of changes in English language skills; this 
statistical test was selected because the data were ordinal and determina- 
tion of ranks difficult with so many students making changes of one or two 
categories on this rating scale. Additional statistical techniques included 
the use of percentage comparisons for those who passed the HSE, and frequency 
distributions to indicate gains in arithmetic competency in relation to time 
in program. 
Time Schedule 

Students were pretested as they entered the program. Before taking HSE, 
students were generally posttested; all students who had not passed the HSE 
and were still in attendance in May 1976i, were posttested during that month. 
Visits by the evaluator were made during the Spring semester. 

Evaluation records and interview schedules were submitted to the evalua- 
tor by the program coordinator in June 1976. 



CHAPTER III 
FINDINGS 

The first evaluation objective was to determine that as a result of 
participation in the bilingual program, the reading grade of the participants 
will show a statistically significant difference between the pretest score • 
and the posttest score. The assessment of this objective was made by 
administering the Stanford Achievement Test, Primary I or Primary II, to all 
students. Ac some centers, studen i scored so high so that a ceiling 

effect was observed were given eh M^^^ , olitan Achievement Test (MAT) or the 
California Achievement Test (CAT). In the Greek Bilingual Program at JHS lOQ, 
the McCall - Crabbs Test in vocabulary and reading comprehension was used. 
At Jaraaica, students who were not participating in the English language skills 
part of the program were not tested for this objective. Students enrolled in 
the Chinese Bilingual Program were also not tested. 

Raw scores, the number right, were recorded for each student for both 
pretest and posttest ori the SAT and _t tests to determine the significance of 
the difference between correlated means were conducted. The same statistical 
test was used for pre- and posttest grade equivalent scores on the CAT and 
McCall - Crrshbs. 

i 

Regardless of test used, significant gains in reading in English were 
obtained in all centers except for a very small* number who took SAT, Level II 
at one school. The objective was attained. Students within the program gained 
in reading in English. These data are reported in Table 3. 
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Table 3 

Changes in Reading in English 



Pretest Posttest Mean 



Center 


N 


Test/Score 


Mean 


Mean 


Diff . 


SDD 


t 


Spanish 
















in 


9 


a 


92.89 


103.33 


10.44 


4.03 


7,33* 


n 


16 


c 


5.94 


7.15 


1.21 


.96 


4.85* 


69 


a 


qr '. 0 


97.75 


7.2(1 


5 .28 ' 


11.36* 




11 




; f^4 


-.85.64 


10.00 


4.09 


7.73* 


/M 


4 


b 


91. JU 


105.50 


14.00 ■ 


2". 45 


9.90* 


15 


a 


73.33 


88 . 87 


15.54 


6.23 


9.33* 


//5 


39 


a 


76.08 


85.44 


. 9.36 


7.28 


7, 93* 


H 


26 


a 


90.27 


100.23 


9.96 


6.66 


7 48* 


in 


69 


a 


86.43 


97.90 


11 47 


R SI 






38 


a 


88.08 


90.97 


2.89 


3.63 


4.84* 


no 


0 












French 


















15 


a 


71.07 


80.53 


9.46 


6.18 


5.93* 




5 


b 


70.20 


81.80 


11.60 


10.64 


2.18 


30 


a 


53.30 


71.87 


18.57 


8.39 


11.92* 




12 


b 


49.58 


72.83 


23.25 


U.ll 


5.88* 


Greek 












m 


53 


d 


3.73 


4.69 


.96 


.60 


11.54* 


Italian 
















#12 


22 


a 


94.00 


103.32 


9.3f 


, 34 


3.94* 


Chinese 
















n 


0 















*£<.0l 

(a) SAT, Level I - raw score (number right) 

(b) SAT, Level II - raw score (number right) 

(c) C^T - grade equivalent 

(d) McCall - Crabbs - grade equivalent 
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The second objective stated that as a result of participation In the 
bilingual program, students will show a statistically significant difference 
between pretest rating and posttest rating in the ability to speak English 
The Sign Test was used for the analysis of the data from 930 students for 
whom teachers completed pre- and posttest ratings on the New York City 
Board of Education Rating Scale of Pupils' Ablxity to Speak English. There 
were 394 pairs that remained the same — showed no change — and six who 
scored the highest rating possible on the pretest and were eliminated from 
further analysis. Only two showed less or a decline from pre- to posttest; 
528 students showed a gain in the rating on the Ability to Speak English 
Scale. This change was ..f^t^d cp be statistically significant. Therefore, 
the objective to improve afeiiiLtT to speak English was attained for a 
significant number of stusfeittsj^ who were tested. The school by school tally 
of the frequency of differGnc* l^tween pre- and posttest rating on Ability 
to Spg?5k English is presesitefl lii Table 4. 
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Table 4 

Frequency DisCribution of Difference Scores for the Ability to 
Speak English and Sign Test Results 



School Total Positive or Gain in 

Pre - Post Rating 







+1 


■+2 


+3 


Spanish 










#1 


21 


12 






#2 


69 


18 


2 




#3 


31 


11 






H 


58 


33 






#5 


156 


93 


17 




H 


37 


9 






#7 


168 


91 . 


5 


1 


#9 


150 


40 


1 




#10 


57 


23 


34 




French 








#3 


28 


13 


-3. 




#8 


42 


37 


3 




Greek 










#11 


56 


36 


12 


1 


Italian 










#12 


56 


33 






Chinese 










#2 


1 









Negative 
Differences 

-1 



Ties 



Maximum 
Scored 



£ or £ (a) 



9 • 




.006* 


48 


1 


.002* 


17 


3 


.012* 


25 




.000* 


46 




.000* 


27 


1 


.004*- 


71 




. 000*- 


108 




.000* 


71 




.000* 


12 




.004* 


2 




.OOO*'- 


6 




.000* 


22 


1 


.000*. 


1 







(a) See Siegel, Non-parame'tric Statistics , 
N.Y.: McGraw-Hill, 1956, 68-74. 



**£<.01 
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Objective #3 stated that as a result of participation in the bilingual 
program, the reading level of the participants in the Spanish, Italian, 
Greek, FreiVch, or Chinese language will show a statistically significant 
difference between the pretest score and the posttest score in the respective 
language. Reading tests in the dominant language were administered to assess 
vocabulary and comprehension. Overall results for each respective language 
were based upon completed pre- and posttest scores for 814 Spanish dominant, 
language students, 96 French dominant language students, 54 Greek dominant 
language students, 45 Italian dominant language students, and 15 Chinese 
dominant language students. 

In eight of the nine centers for Spanish :dominant language students, 
it was found that the difference between pre- and posttesting was signifi- 
cant. Posttest. means were higher .than pretest: means. The results for the 
French bilingual program. indicated significant gains at both centers. 
Students in the Greek, Italian, and Chinese bilingual programs also showed 
significant gains in reading in their respective dominant ^ language. The 
objective was attained. The results of these analyses, school by school, 
are reported in Table 5. 
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Table 5 

Changes in Reading Comprehension in the Dominant Language 



uouim£inu 


School 




Pretest 


Posttest 


Mean 






Language 




N 


Mean 


Mean 


Difference 




t 






48 


70.81 


71 . 90 


1.08 


7.18 


.- 

1.03 






59 


61 . 26 


70. 17 


.8.91 


5.04 


14.56* 




iU 


35 


58.54 


67.43 


8.89 


8.54 


6.07* 




A A 


58 


52.03 


66. 12 


14.09 


11. 10 


9.58* 






160 


61 .59 


77.03 


15.44 


9.57 


20 . 34* 






63 


66.75 


73.25 


6.50 


5.91 


8.66* 




if! 


172 


53.50 


63.69 


10.19 


12.03 


11.08* 




#9 


150 


59.05 


65.20 


6.15 


6.27 


11.98* 




#10 


59 


63.66 


75.90 


12.24 


6.80 


13.71* 


FrenchAJb) 


#3 


52 


6.64 


9.13 


2.49 


1.17 


15.26* 




#8 


44 


6.59 


9.43 


2.84 


.78 


23.95* 


Greek ta") 


m 


54 


12.50 


14.81 


2.31 


1.73 


9.73* 


Italian (sl) 


m 


-45 


59.91 


68.76 


8.85 


10.27 


5.71* 


Chinese ^a^ 


#2 


15 


76.60 


80.47 


3.87 


3.33 


4.35* 



(a) 
(b) 


raw score - number right 
grade equivalent 


*JEL<.01 
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For objective //4, as a result of participation in the bilingual 
program, the mathematics grade of the participant will show a '-statistically 
significant difference between the prerating and the postrating, tr ^ 
New York Arithmetic Computation Skills Test was administered in the dominant 
language. School by school results indicated statistically significant gains 
at e\rery site. The objective of growth im mathematics, w^ attained. 
These data are presented in Table 6. 



21 



18 



Table 6 

Changes in Ma the- "rade Equivalents Mi. ured 

in Che Dominant l. .^:uage 



Dominant 


School 




Pretest 


PosttesC 


Mean 








Language 




N 


Mean 




Mean 


Difference 


SDD 




t 


Spanish 


in 


46 


5. 


^35 


6 


.53 


1 


.18 


1.17 


6 


.77* 




n 


69 


5. 


46 


6 


.47 


1 


.01 


.74 


11 


.27* 




n 


35 


5. 


07 


6 


.21 


1 


. 13 


.89 


7 


.37* 




//4 


55 


5. 


23 


6 


. 98 


1 


.75 


1.14 


11 


.33* 




//5 


158 


5. 


58 


7 


.23 


1 


.65 


1.22 


16 


.92* 




//6 


62 


5. 


70 


6 


.93 


1 


.23 


1.29 


7 


.45* 




■ in 


170 


5. 


25 


6 


.04 




.79 


.86 


11 


.88* 






150 


5. 


47 


5 


.98 




.51 


.45 


13 


.97* 




//lO 


59 


5. 


88 


7 


.27 


1 


.39 


.98 


10 


.75* 


French 


« 


43 


6. 


80 


8 


.64 


1 


.8^ 


1.75 


6 


.79* 






46 


6. 


54 


8 


.93 


2 


.39 


1.42 


11 


.27* 


Greek 


m 


54 


4. 


88 


5 


.58 




.70 


.66 


7. 


,76* 


Italian 


nz 


42 


8. 


83 


10. 


.13 


1 


.30 


1.29 


6 


.53* 


Chinese 


n 


16 


7. 


54 


9" 


.33 


1 


.79 


1.10 


6 


.33* 



*£<.01 
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Test data from centers having the same dominant language bilingual 
program were analyzed to determine gains in grade months in relation to 
tha number of months in the program. For each dominant language, a 
majority of the students achieved one or more grade equivalents per 
month of participation in the program; i.e., a majority of students in the 
program four months showed gains of four grade equivalents or more in pre- 
posttest comaarisons. See Table 7. . 



Table 7 

Gains in Mathematics in Relation to Number of Months 
in the Program 



Bilingual Program 

Spanish French Greek Italian Chinese 
(N=804) (N=89) (N-54) (N-42) (N=16) 

Gained the sams or greater No. % No. % No. % No. % mo. % 
number of grada equivalents 

as months.-.of. participation, 572 71. 1 77 86.5 37 68.5 26 61.9 15 933 
iniiprogram 

Gained fewer, :remained the 232 28.9 12 13.5 17 31.5 16 38.1 1 6 2 
same, or lost grade equiva- 
lents 
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Objective stated that as the result of participation in the bilingual 
program, at least 80% of the students enrolled in the bilingual preparation 
component. for the HSE examination (Spanish language form), will pass the HSE 
in Spanish. The objective of. passing the HSE was the goal for most students 
in the bilingual program, regardless of dominant language. However, students 
who were French, Greek, Italian, or Chinese found there was no prospect for 
them to take the HSE in a form in their native language. These students must 
take the examination in English. The implication for the program is the 
emphasis on ESL to develop English language skills for these students, and 
the emphasis on Spanish language skills and the content areas for Spanish 
language students. 

The number of students who took the Spanish HSE in the school year 
1975-1976 from the bilingual program was a total of 474. Of those, a total 
of 167 passed, or 35.2% of them. At this writing, the results were not 
known for 61%. Among students whose results were known, more than 90% passed 
in HSE*. In the light of these results, it is clear that the criterion 
established for this evaluation objective, that over 80% of the students from 
the bilingual program who took the HSE in Spanish and for whom results were 
available at che time of this report passed, has been exceeded. HSE results 
are reported in Table 8. 



*An additional 47 received their test results before this report was duplicated; 
37 or almost 80% passed the HSE. o 4 
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Table 8 

Results of High School Equivalency 





Number Who 


Number Whose Results 


Passed 


Failed 


School 


Took HSE 


Are Known 


No. 


% 


No. 


% 


Dpa.nisn 




• 










HSE 














#1 


A3 


19 


19 


100 


mm 




#2 


A2 


18 


lA 


77.8 


4 


22.2 




35 


13 


12 


92.3 


1 


7.7 


H 


2A 


• A 


1 


25.0 


3 


75.0 




139 


58 . 


5A 


93.1 


A 


6.9 


H 


15 


7 


7 


100 






■ in 


88 


31 


29 


93.5 


2 


6.5 


//9 


68 


27 


23 


85.2 


A 


14.8 


#10 


22 


8 


8 


100 






English 














HSE 














#3 


11 


5 




100 






#8 


3 


, 1 


1 


100 






#11 














#12 


12 


2 


2 


100 






#2 
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' A small number of students enrolled in bilingual programs other than 
Spanish took the HSE in English* Among those for whom test results are known, 
all passed. These date are also included in Table 8. 

The sixth evaluation objective was to assess the discrepancy between the 
program as described in the proposal and planned and actually carried out in 
the implementation. The results of this discrepancy analysis accumulated from 
observations and intervie^^/a with program staff while on-site and at conferences, 
indicated that generally the program as carried out coincided with the program 
as described in the proposal. - 

In establishing the bilingual program in ASHS at each center, community 
and community agencies participated. Most centers had high registrations and 
waiting lists. Attendance levels varied among center.:. At some it appeared 
that more participants could have been served. In thv: ongoing operation of the 
program, parent and community participation was generally low; however, some 
educational advisors had organized active student gro::ps at their respective 
centers. 

Inmost centers, individual program objectives were set. Educational 
advisors and/or guidance counselors maintained a folder for each student which 
contained a student's program and educational activities. Records of interviews 
were included. The program coordinator had introduced a cumulative record card 
for each student upon which test information, date of entry and withdrawal were 
recorded. 

Instructional activities varied, among centers and according to student 
needs. In some centers, each student worked with individual assignments and re-^ 
ceived tutuorial assistance from teachers and/or paraprof essionals . At other : 
centers, small groups worked together with a staff member.' In still others, 
large group instruction was implemented. 
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The Spanish bilingual program emphasized Spanish language skills and 
content in Spanish. The French, Greek, Italian, and Chinese bilingual pro- 
grams concentrated on ESL and English reading skills rather than on improve- 
ment of dominant language skills and cultural heritage. This situation 
reflected the apparent primary goal of the program which was passing the HSE. 
Once it was found the HSE was available only in Spanish and English, the 
Spanish language students concentrated on content and Spaniah language skills, 
whereas the Italian, Greek, French, and Chinese students concentrated on 
English. Student programs reflected this situation. 

Curriculum has been designed by educational advisors, teachers, and the 
curriculum coordinator who also obtained fine materials, primarily in Spanish. 
Materials in French appeared adequate; the educational advisor was planning to 
design materials in French or Haitian literature. In the Chinese bilingual 
program the teacher had designed many materials for oral - aural exercises in 
learning English. In addition, he adapted many reading materials for teaching 
Etiglish language skills. Little if any materials were used or developed for 
improving skills in Chinese. Materials in the Greek bilingual program were 
inadequate, in the Italian bilingual program, more satisfactory. Whatever 
materials were available and/or requested from the coordinator by center 
personnel were quickly sent to a center from Clemente whare the curriculum 
reference library was located. 

Centers had few resource libraries of their own for either staff or 
pupils » primarily because of space and storage constraints. Some centers 
had no storage facilities; in others, there was one steel closet for all 
materials and equipment at that center. 
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In one center, the "library" was a steel cabinet kept in a small, unheated 
ante, room that also served as an E2L center, slnca available space in the 
multipurpose "classroom;' room was divided among reading instruction in 
English, in French, and in Spanish, and "mathematics instruction in English, 
all of which occurred simultaneously. 

Communication among bilingual program components was minimal. Con- 
tact with Glemente tended to bT' greater among day schools and Spanish 
bilingual program staff than evening and other language staff. However, 
opportunities were planned and implemented for staff development. Confer- 
ences, institutes, workshops at Clemente and elsewhere, college and 
university programs and courses were provided for teachers and educational 
advisors. Each center provided independent training for paraprof essionals 
which varied among centers. Development and ;:raining appeared most satis- 
factory for those in the Spanish jilingual program and for those in day 
schools. 

r 

There have been many accomplishments of the bilingual program for ASHS 
during the school year 1975-1976. There have been many consistent efforts 
to use counseling along with instruction to individualize educational and 
.vocational ojsjectives for each pupil. The average number of months a stu- 
dent remained in the program ranged from three to nine, while the average 
number of counseling interviews per student ranged from three to ten. It is 
obvious that, in general, students, talked with guidance counselors and/or 
educational advisors approximately once a month. 

Although not all guidance counselors were bilingual, they worked very 
closely with the educational advisors who were. The effectiveness of this 
procedure was demonstrated in part thEough motivation for HSE, college, and 
vocational training. Results from the HSE in Spanish and English indicated 
that approximately 80% of the students who took the exam passed it. More 
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than 20% of the pupils In the program applied to college and of these some- 
what less than half were accepted. Therefore, approximately one-third of 
the students in bilingual AS1;S received college acceptance. A similar 
proportion were accepted into vocational training programs. Although joB 
placement . opportunities were extremely limited and few centers had job devel- 
opers or bilingual job developers, job placement was effected for four per- 
cent of the students. These statistics indicate the enthusiasm and perse- 
verance of staff and students in bilingual ASHS. 
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CE4PTER IV 

SmiMARY H? mJOR FINDINGS, CONCLUSIONS, AND RECOHHENDATIONS 



general, tlsar_r -^^ts of this ^VcaTlTze.^.r::ig3n sho^d that the biidngual 
prr^am in ASHS die a. /e the basic eval t^^iiciion objTsctives fax the: stu-- 
deoEs for whom dsrza ur. available. 

The students fc X^^^m completed results were analyzed sb:^l^^>^ signiSSr- 
canc gain in their 5ig^L5h reading scores>. 

The results of t±:nr language assessmerr rating by teachers of student 
ability to speak English showed significant improvement on the rating 
scale. Many of the students began at the lower levels' of the scale, ^ 
showing little or no English, and they have acquired more skills in speak- 
ing English than they had prior to the program. However, it is clear that 
the bulk of the students in the program still have not mastered the skills 
of speaking English. While there has been progress that is significant, more 
development is needed. The rating scale itself has been the subject of 
severe criticism, relying on teacher judgment. It is highly subjective and 
general in its categories. 

Reading in native or dominant language also showed significant gain: in 
each of the respective languages for students whose test results were com- 
plete^ The tests used had limited reliability and validity. Prueba de 
Lectura was the only instrument used to measure reading in Spanish; lack of 
normative data precluded the use of grade equivalents and limited assigning 
meaning to the average number of questions answered correctly. The Laboratoire 
de Lecture , the adapted Fretch test, directly linked evaluation to instruction/ 
but failed to provide meaning for the posttest except to indicate a ''gain'\ 
Another independent test^ perhaps the French Regents or Coopi^ta'tiVe Language 
Test would augment the measure. The tests for Greek, Italian, and Chinese 
were project - developed, teacher-constructed tests. Regardless of the ^ 



limitations of the rairlo^s ccesCsTj. the results showed there were gains that 
were statistically sigaii- -2:d the objective was reali^eci. 

Assessment ±n mat..?^'^?ff c^j: auT^ i-ig the twelve centers si^' - ad significant g«tas 
In grade equivalents. 

For those students -^^so. teE&orts were known, approximssely 80% passed the 
HSE. The present reporttai sy§JSi3¥f made scoring the data difficult. Moreover., 
many students took the. tes- ifcfe ivaluaticm data were ccvilected. 

This program desexvew insinuation. Xt^ is a program tiat not only serve^i 
many bilingual potential c^I irop-outs,^ but many who ace new to this coucarry. 
Some- gains may appear smaii to the students in this pxasram they are real. 

For some, this is their fiii-t ©jfjaesience of^;success. 

The evaluator of the . )74'4i^.73 bilingual program in ASHS recommended the 
following: 

1. Maintenance of a low profile to consolidate the" program; 

2. Staffing thei Fco^sm with tpersons who have more than bilingual 
qualification's, who have middle school certification, knowledge 
of native cuianire, iudividuaiization of instruction, arid not 
merely foreign: laas^iiia-ge. teaciers; 

3. Strengthening or iSanaal testing; 

4. Bringing EnglilMi iritg every area; 

5. Viewing bilingual ASHS as a system. 

These recommendations were implemented to some extent. There was no expan- 
sion of the bilingual prograia iii..^SSS except to introduce a Chinese language 
bilingual program at an ali^dy .=ss-.t^lished bilingual center. The recruitment and 
selection of staff have suffered because of budgetary constraints. In most ceuters,. 
professional and paraprof es:Mcm»l staff were native to the dominant language and 
possessed some teacher certification. Motivation and dedication were high. Staff 
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development and training for increas:.ng skills in bilingual educ^ :itm, individ- 
ualized instruction, curriculum development, and testing are essential. The 
importance of formal testing has been accepted generally. At soi::^ (inters, 
however, tiests that appeared irrelevant to student programs wprp .-rs -^^f. ,^ , 
Emphasis on the need for pre- and posttesting should be included in ^ordinsiror 
- center coimnunications. Standardized procedures and materials iave-^een intro- 
duced and were implemented. All centers used the cumulative reccsii -ard for 
student test,.da.ta.. At most centers, an individual folder was maintained for 
each student which included program and progress through ASHS. 

Implementation of recommendations was weakest in curriculum. Oral and 
written English language skills tended to be minimal in Spanish bilingual pro- 
grams and dominant language skills tended to be minimal in other language biliis- 
gual programs. Bicultural curriculum was also limited. 

Recommendations for the program as a Result of the 1975-1976 evaluation 



are: 



Development and selection of more suitable tests in both English 
language and dominant language skills; 

Integration of English language skills and dominant langu^e .^cLELs 
in every sitofient's program; 

Development: .of bilingual and bi-cultural curriculum for bilin- 
gual program, especially languages other than Spanish; 
Increased communication between the coordinator and bilingissL .staff , 
particularly at evening denters; 

Staff development and paraprof essional training::in individual±2Ei3: 
instruction, techniques of teaching, test development; 
Curriculum daevelopment and implementation to improve language skills 
of illiterates who need bilingual education^ 



All these ^recommendations, parti-ii^iarly riiimbers 1 and 6, may 
unfeasible for -xrse program to implement. These stxould be implement's^ 
by the joint e G ^iz ts the Offtce of Bilins^ial Il&cGationv the Office 
of Ednicational ]Svalusr±on, and the indiviidual -proKrams. 



APPENDIV - nT^CSSffffiCY CHECKLIST 



fcnber erircji^d iin2SL 
Hvaber cnroj^JLed in 1511 
Ccsanunity T??»spons^ » :hd^ school 

Hcwf ifl therg^'roiirfrTr.cengBggb. of the^., 

cul tT2sal_ id«n±±£5r cnf the s tiid en t? 

S.taff iaproveaent ;53SE5€S^ 
workshops at tyrro-^r ^ 

Institutes 

conferences 

university praj^ams 
Spanish ' cur • ' .culm jiro totyre amilable? 
Resource library in centcrr 

Use of prafisflsional xef essence 
library afcuGOtementa 

Para advancemenfciife collcsgs 

3i-cultural curKStecLum .drovelqpnjsmt 
resourta 2Elle 

Classroom: 



teac±rtfr-4-t2saa^jy" 



kiad of -'Ti:ifc.,'^^c,.';'r:ri 
SSA i2i::3iatS: 
Internal-, fo rsis for fsscmati-ve esrsluatlon: 




34 



BILINGmL HBOGRAM 
ASHS 



Afflmini*»ttator Dominant Language 

Centar_ Da gr E^/«iing 



Total Enrolled 



I* Platmlng and Devalopmettt 

1-1 Curriculum ims been pre|>ared in: 

Subjects iJBBBguagea 



1.2 Explain parei^ fojain migy paw*Sfet|itttloa: 



2 . 3;taff Developmetit: 

2.-1 Number of profesfaSonal voxdcafaapa ae rown Center 



2:. 2 Ntmiber of professslona^ workshops at :other Centers 
*2.2 Describe other-^nrofcmionaa. training: 



2.4 



Describe paiXfSssssSmd^im^ 



3. Gounaallng 

3.1 Extent of college coimselteg and orientation 

3.2 Extent of counseling on vocational and Job sktSla 

3.3 Types of Joba developed: 
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Instruction 

4.1 Indicate the kind o£ Instruction for the following classes: 

Ind Ivldua 1 I2 e d Structural Group 

English Langtage Skills 

Basics I _ • 

Int. II ^ 

Int. Ill ^ _ ■ 

Adv. vr ^ 

Reading In English 

Rd. I 

Rd. II 

Rd. Iir ^ ; 

Rd. IV ' 

Domlnanf: tang«. Skills 

Int. 

Adv. 

Satellite 2 " ^' 

Mathetnatlca 

H.S. Equlv. 

4.2 Indicate adequacy of: 

Equipment — - .. ... . . .... .. — 

Material _ ' • ' 

Testbooka.^«^__^ 

Storsg® availability 



5. Recoaoaenddtlons 
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ERIC 



Meeting April 30, 197& - 10 ram 



Topic: 
Agenda : 



Program Evaluation 



1. Program Strengths 

2. Program Weaknesses 
3 • Recommendat ions 

4. Evaluation Frocedurea 

4.1 FormatiVe Evaluation 

4.2 Summative Evaluation 



Please prepare a statement on program strengths, weaknesses, and recommendations 
for: 

a. ,,^puT Center 

b« A'^JS.H.S. in general 
c. Title VII in general 

Specific reference., should be made to: 

1. Administrative matters 

2. Curriculum development 

3. Educational, vocational, av^d bilingual counseling 
as related to college placement, Job development 
and placement, and bilingual 

4. Clerical skills instruction 
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■ >• OFFICE OF EDUCATIOHAL EVALUATION - DATA LOSS FORM 

(attach to Mm, item #30) Function it 

In this table enter all pata loss infomiatlon. Between MIR, item #30 and this fomi, all partfclpantB 
: in each activity must be accounted for. The component and activity codes used in completion of item ^130 
' ishould be used here so that the two tables match. See definitions below table for further instructions. 



Coapdnent 
Code 


Activity 
Code 


Group 
IX 


Test 
Used 

• 


Total 
N 


[V 

Number 

Tested/ 

Analyzed 


(5) 

Participants . 
Not Tested/ 
Analyzed 


(6) 

Reasons why students were not tested, or if 
tested, were not analyzed 

Number/ 


N 


I 




leason 




















Eng. 

Read. 

(a) 


1243 


433 


810 


65.2 


Absence 

left Droeratn before pos^^e.q^^ne 


139 


Not in ESL 

used different test for posttest 


601 
4 




















heading 

Dom. 

Lang. 

fb) 
\"j 


1243 


1024 


,219 


17.6 


left program before posttestinj^ 


200 ' • 


Vietnamese In Chinese program 
ADbcnce 


"3' 

10 




















Math; 

NACT 

(c) 


1243 


1005 


238 


19.1 


left program before posttesting 


21< 


Absence 






















W" 

Lang. 

Fluenc 
(d) 


1243 


930 


313 


25,2 


left program before posttesting 


252 


Not in ESL 


36 






























Absence 
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(1) Identify the participants by specific grade level (e.g., grade 3, grade 9). Whore several grades ire combined, 

enter the last two digits of the component code, 

(2) Identify the test used and year of publication (MAT-70, SDAT-74, etc.), 
,(3) Number of participants in the activity, 

(4) Number of participants included in the pre and posttest calculations found on iten>if30. 
;(5) Number and percent of participants not tested and/or not analyzed on Item^BO, 

(6) Specify all reasons why studcnto were not tested and/or analyzed. For each reason specified, provide a separate 

4 J number count. If any further documentation is avoUoble, please attach to this form, If further ipace la 

/ A and explain data losa, attach additional pages to this form, 

;:(aV fiAj CAT, or McCalRrabbs 

8bERlC"a;;de;;;Lectura, JRA laboratolre dea L developed/adapted tests 

icjTAaininlstered In^ dominant language , . , , ' ;, ■ 



Bilingual Program in Auxiliary Services for 
High Schools 

ABSTRACT 

The bilingual program in the Auziliary Services for High Schools (ASHS) 
aimed at improving language skills in English and the student's native or 
dominant language, math skills, and attainment of the High School Equivalency" 
(HSE) diploma. In the 1975 - 1976 school year there were twelve bilingual 
centers, four day and eight evening. Bilingual programs were offered in 
Spanish, French, Greek, Italian, and Chinese. , 

The results of the evaluation showed that the basic evaluation objectives 
were achieved by students for whom data were available. English reading scores 
showed significant gains between pretest and posttest. Changes in ability to 
speak English were also statistically significant, with most changes indicative 
of improvement in skill. Reading in native or dominant language showed signifi 
cant gain in each of the respective languages for students whose test results 
were complete. Assessment in mathematics showed significant gains in grade 
equivalents. For students whose HSE results were known, 'approximately 80% 
passed. 

This program deserves continuation. It is a program that not only serves 
many bilingual potential and real drop-outs, but many who are new to this 
country. Some gains may appear small, but to the students in this program they 
are real. For some, this is their first experience of success. Enthusiasm and 
perseverence of staff and pupils are responsible for attainmer of program 
objectives. 



